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In  many  applications  employing  a  symmetric  matrix  and  its 
generalized  (Penrose-Moore)  inverse  the  matrix  is  given  in  a  natural  way 
as  the  finite  sum  of  symmetric  dyadic  matrices  and  pairs  of  nonsymmetric 
dyadic  matrices.  In  this  paper,  formulas  are  given  for  the  generalized 
inverse,  ,  of  B  =  A  +  a)Q'!+  baj  for  A  symmetric,  a,b  vectors. 
There  are  nine  distinct  cases  which  oust  be  considered.  The  application 
of  these  formulas  is  given  to  the  computation  of  an  estimate  of  the  pos¬ 
itive  part  and  directions  of  negative  curvature  for  a  symmetric  matrix. 
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1.  Introduction 

In  many  applications  employing  a  symmetric  matrix  and  its  gener 
alized  inverse,  the  matrix  is  given  in  a  natural  way  as  the  finite  sum 
of  symmetric  dyadic  matrices  and  pairs  of  nonsymmetric  dyadic  matrices 
That  is,  if  A  is  a  symmetric  matrix,  then  A  is  given  as: 


?  d  c  d?  +  J  a.b 
^  iii  J 


T  ,  T 

j +  Vj 


for  some  p  and  q  integers  greater  than  or  equal  to  0,  where  each 


d^  ,  a^  and  b^  are  n  x  1  vectors  and  each  c^,  is  a  scalar.  For 


example,  the  Hessian  matrix  of  the  product  of  two  linear  functions 
f (x)  and  g(x)  : 


V2 [f (x)g(x) ]  =  g(x)V2f(x)  +  f(x)V2g(x) 


+  Vg(x)(Vf(x)}T  +  Vf(x)07g(x)) 
Vg(x)(Vf(x)]T  +  Vf(x)CVg(x))T 


has  this  structure. 


♦Much  of  this  material  is  taken  from  Leaver  (1984) . 
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The  generalized  (Penrose-Moore)  Inverse  of  a  matrix  A  is  the 
unique  matrix,  A+  ,  which  satisfies  the  following  four  properties: 


AA+A 

*  A 

(2) 

A+AA+ 

-  A+ 

(3) 

(a+a)t 

=  A+A 

(4) 

„  +.T 

(5) 

(aa  r 

=  AA  . 

Ben-Israel  and  Greville  (1974)  provide  existence  and  uniqueness  proofs 
for  the  Penrose-Moore  inverse. 

When  A  is  expressed  as  in  (1),  A+  can  be  computed  recursively 

In  particular,  any  pair  of  nonsymmetric  dyads  can  be  written  as: 

.T  ,  ,  T  IT  IT 

ab  +  ba  =  u  u  —  v  v  , 


where 

u  **  a  +■  bk  , 
v  *  a  -  bk  , 

kM, 

and  A+  can  be  computed  recursively  as  the  generalized  inverse  of  a 
matrix  A  perturbed  by  a  series  of  symmetric  dyads.  Formulas  for  up¬ 
dating  A+  when  A  is  perturbed  by  a  single  dyad  were  found  by  Meyer 
(1973)  and  McCormick  (1976).  Meyer's  results  cover  the  general  case 
when  neither  A  nor  the  dyadic  perturbation  is  square  and  symmetric. 
McCormick's  formulas  are  special  cases  of  Meyer's  results  and  apply  when 
both  A  and  the  dyadic  perturbation  are  symmetric. 

In  the  following,  formulas  are  given  for  the  generalized  inverse, 
+  T  T 

B  ,  of  B  *  A  +  ab  +  ba  for  A  symmetric.  There  are  nine  distinct 


cases  which  must  be  considered. 
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2.  Formulas  for  Updating  a  Generalized  Inverse 


We  begin  by  first  defining  a  matrix  P  which  maps  every  vector 


into  the  null  space  of  A  as: 


P  ■  I  -  A  A  . 


The  following  relations  hold: 


PT  =  I  -  (A+A)T  =  I  -  A+A  =  P  by  (5), 


(ii)  AP  =  A-  AAA  =  0  ,  by  (2), 


(iii)  PA  =  (AP)1  =  0  ,  by  (7)  and  the  symmetry  of  A  and  P 

(iv)  (A+)T  -  A+  . 

Proof : 

(AA+A)T  -  AA+TA  »A  by  (2). 

(A+AA+)T  =  (A+)TA(A+)T  =  A+T  by  (3). 

C(A+)TA3T  -  ATA+  =  AA+  =  (AA+)T  by  (4), 

=  (A+)TA  . 

(a(A+)T)T  -  A+AT  -  A+A  =  (A+A)T  by  (5), 

=  A(A+)T  . 

+  T 

Hence  (A  )  is  a  Penrose-Moore  inverse  of  A  and 

+  T  +  + 

(A  )  -  A  by  the  uniqueness  property  of  A 

(v)  (AA+)  -  (AAV  =  (A+)TAT  =  A+A  ,  by  (4),  (9)  and  the 
symmetry  of  A  .  Thus 


(vi)  P  ■  I  -  AA  ,  by  (10). 


-  3  - 


(11) 
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(vii) 

A+P  -  A+  -  A+AA+  -  0  -  (A+P)T  =  PA+  . 

(12) 

It  also 

will  be  useful  to  recall  from  Halmos  (1958) , 

(vili) 

If  A  =  AT  ,  B  -  BT  ,  then 

AB  -  (AB)T  Cand  BA  ■  (BA)T)  AB  =  BA  . 

(13) 

(ix) 

Rank(A+B)  ^  Rank (A)  +  Rank(B)  ,  and 

Rank(A+B)  >  |Rank(A)  -  Rank(B) |  . 

(14) 

(x) 

For  A  an  n  x  n  matrix. 

(15) 

Rank(A)  +  Nullity (A)  =  n  . 

Theorem  1: 

If 

Pa  -  0 
Pb  -  0 

and 

T  +  T  +  T  +  2 

a  A  a  b  A  b  -  (a  A  b+1)  i  0  ,  (18) 

then 

Rank(B)  =  Rank(A)  ,  (19) 

and 

B+  =»  (A+abT+baT)+  =  A  +  (a,b)  j^j  J 

•—  J  (b  J  I 

i*+<->w  +  [? i]]  (°ta+-°-  <2o> 


-  A+(a,b) 


(16) 

(17) 


-  4  - 
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Proof :  Note  first  that  by  (16), 


Now 


-  5  - 


[* *  [!  J]  (>]*+<--»]  -  [°1  i]  [[J|‘V.«  ♦  [? ;]] 


so 


BG  ”  AA  +  (ab) 


t 

fo  l] 

a 

Li  oJ 

bT 

A+ (I-I)  -  AA+  . 


(23) 


Hence  (BG)  -  BG  by  (4).  Let  Q  -  (I-BG)  .  Now  by  (23),  Q  =  P  , 
so  by  (15)  it  follows  that 

Rank(B)  ”  Rank (A)  . 

Then 

BGB  *  (AA+ ) (A  +  abT  +  baT) 

+  +  T  +  T 

—  AA  A  +  AA  ab  +  AA  ba 

T  T 

=  A  +  ab  +  ba  =  B 

by  (2),  (21),  and  (22).  Thus  (2)  holds.  Noting  that  G  is  symmetric 
by  (20) ,  we  then  have  by  (13)  that 

BG  -  (BG)T  4=^  GB  »  BG 


->  (GB)  =  GB  , 


and  (5)  holds.  Then 


GBG 


[V  -  A+(a,b)  [|*T]A+(a’b)  +  [  1  o]  ]  [^]A+]  *  A 

A+AA+  -  A+(a,b)  [[^+(a,b)  +  [J  j]  j  |^JA+AA+ 

A  -  A  (a,b)  ^  |a^,| A+(a,b)  +  [i  qJ  j  jaxjA+  ^  ^ 


=  G  ,  and  (3)  holds 
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and 


(32) 
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and  from  (26),  (27)  and  (28)  it  follows  that 


T  + 

a  A  b  *  -1  . 


F  -  [?  o]  •  C-  [[^]A+A+(a-b)]  •  ‘“d  D-  [Kk+AV(a,b)j 

Note  also  that  aTA+A+a  i  0  (and  similarly  bTA+A+b  4  0),  since 
Aa=0”^Pa=a^0,  a  contradiction,  and  that 


aTA+  i  kbTA+ 


for  any  k  f  0  , 


since 


T  +  t  +  t  +  T  + 

a  A  =  kb  A  aAa»kbAa*^0=k-l  =■=>  k  =•  °  , 
another  contradiction.  Hence 

det  C  =  aWa  bTA+A+b  -  (aTA+A+b)2  i  0 
and  C  has  an  inverse.  Now 


BG  -  ^A  +  (a,b)F|^j  j  . 

£a+  -  A+A+(a,b)C  1  |aT| A+ 
+  A+(a,b)C_1DC_1|aTjA+J 


b)C_1  3  A+  -  A+(a,b)C-1  a1  A+A+ 
b  b 


T  t) 

AA+  -  AA+A+(a,b)C~1  3  A+  -  AA+(a,b)c'1  3  A+A+ 

ib  |bTJ 

T]  T-j 

^  AA+(a,b)C-1DC"1  3  A+  +  (a,b)F  3  A+ 

lb  lbTJ 


-  8  - 


where 


T  + 
a  A  a 
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-  (A+a  -  Pb(a  +  aTA+b  +  1)*?  1>a“1CaTA+  -  ?"1(a  +  aTA+b  +  l)bTp} 
G  ,  (66) 


a  =  aTA+a 
?  =  bTPb  . 

Proof:  Note  that  by  (63)  and  (64),  b^Pb  =  b^PPb  >  0  ,  and 

i  0  and  thus  have  inverses.  Now 

t  t  f  +  +  -IT  -1  T  + 

BG  =  (A  +  ab  +  ba  )  A  -  A  (a+b)?  b  P  -  Pb?  (a+b)  A 

+  PbC(a+b)TA+(a+b)  +  2j?"2bTP 

-  (A+a  -  Pb(a  +  aTA+b  +  1)5  ^  a_1[aTA+  -  ?_1(a  +  aTA+b  +  l)bV)j 

=  AA+  -  AA+(a+b) ^_1bTP  -  (AA+a)cT1CaTA+  -  ?_1 (a  +  aVb  +  l)bTpJ 

T+  T+  -IT  T— 1  T4- 

+  ab  A  -  ab  A  (a+b) 5  bXP  -  ab  Pb?  (a+b)XA 
+  abTPb((a+b)TA+ (a+b)  +  2)?~2bTP 

-  a(bTA+a  -  bTPb(cx  +  aTA+b  +  1)  ?“1)cr1(aTA+  -  Z~1(ct  +  aTA+b  +  l)bV) 

T  +  T  +  -IT 

+  ba  A  -  ba  A  (a+b)?  b  P 

-  b(aTA+a)a~1[aTA+  -  ?_1(a  +  aTA+b  +  l)bV) 

+  -1  T  +  -1  T 

=  AA  -  a?  b  P  -  AA  b?  b  P 

—  1  T  +  —1  —1  T  +  T  t  4- 

-aa  aA  +aa  ?  (a+aAb+l)bP+  ab  A 

-  a(bTA+a  +  bTA+b) ?_1bTP  -  aaTA+  -  abTA+ 

+  a((a+b)TA+(a+b)  +  2)?-ibTP 
-1  T  + 

+  a(a+l)a  a  A 


« 


-  23  - 


I 
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« 

Note  also  that 

« 

B(A+v)  =  0  . 

Proof : 

f,  x  IT  1  t],+  a  a+  , 

1  T.+ 

1  Ta+ 

IA  +  u  —  u  -  v  v  Av  =  AAv+u 

2k  u  A  v  - 

v^vAv 

• 

=  v  -  v  = 

0 

'■ 

by  (46),  (47),  (57)  and  (58).  But  also  by  (46) 

and  (47)  , 

i 

AA  v  =  v  M  . 

So,  as  in  Theorem  3, 

Rank(Q)  =  Rank(P)  +  1 

■ 

and  by  (15)  we  have 

• 

Rank(B)  =  Rank (A)  -  1  . 

Theorem  5: 

If 

” 

Pa  =  0  , 

(62) 

■ 

Pb  *  0  , 

(63) 

and 

*1 

T+  ,  „ 
a  A  a  ^  0  , 

(64) 

« 

then 

Rank(B)  =  Rank(A)  +  1  , 

(65) 

and 

9 

B+  =  A+  -  A+(a+bK_1bTP  -  Pb?"1 (a+b)TA+ 

+  Pb((a+b)TA+(a+b)  +  2}?"2bTP 

» 

*,  Mm 


A 
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-  A  (u  -  v6  ^(vTA+A+u)3(4aTA+a)  X(u  -  v6  X(vTA+A+u)3TA+3 
=*  A  AA+  -  A+AA+A+v6  XvXA+  -  A+AA+v6~^vTA+A+ 

+  A+  AA+  v6  2(vTA+A+A+v)vTA+ 

-  A+AA+Cu  -  v6-1 (vTA+A+u)3 (4aTA+a) -1(u  -  v6-1 (vTA+A+u)}TA+ 

-  aVVaV  +  AV2(vTA+AVv)vTA+ 

+  A+v6  2(vTA+A+v)vTA+A+  -  A+v6"3(vTA+A+v) (vTA+A+A+v)vTA+ 

+  A+ v6  1vTA+A+ (u  -  v6-1(vTA+A+u))(4aTA+a)'1Cu  -  v6_1(vTA+A+u))TA+ 
=  A+  -  aVvS-Va*  -  A+v6'1vTA+A+ 

+  A+v6  2(vTA+A+A+v)vTA+ 

~  A+Cu  ~  v6"1(vTA+A+u)3(4aTA+a)~1(;u  -  v6-1(vTA+A+u)]TA+ 

+  A+v6'1CvTA+A+u(l-l)3(4aTA+a)"1Cu  - 

-  A+  -  A+A+v6'1vV  -  A+v6'XvTaV 

+  A+v6  2 (vTA+A+A+v) vTA+ 

-  A+(u  -  v6'1(vTA+A+u)3(4aTA+a)"1(u  -  v5_1 (vTA+A+u))TA+ 


Let  Q  =  I  -  BG  .  Then  by  (61), 

Q  =  P  +  A+v6_1vTA+  . 

Now  (46)  and  (47)  imply  that 

Bx  -  0  for  all  x  satisfying  Ax  =  0  , 

which  implies 


Rank(Q)  ^  Rank(P)  . 


21  - 
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1  "  4aTA+a  +  uVu  =  1  -  ^  (4aTA+  a  -  4aTA+  a  +  2k) 


So  (60)  gives  us 


1  -  2k  (2k)  "  0  * 


BG  =  AA+  -  A+  v6  ^v^A+  , 


which  is  surametric  by  (4) .  Note 


T  T 

G  *  G  and  B  =  B 


give  us  by  (13)  and  (45)  that 


GB  =  BG  =  (GB) 


and  (5)  holds.  Now 


BGB  »  (AA+  -  A+v6-1vTA+) (A  -  v  vT  +  u  uT) 
=  AA+A  -  AA+v  ^  vT  +  AA^u  ^  UT 


-  A+v6  1vTA+A  +  A+v6_1vTA+v  ~r  vT 

2k 

a+  j^1  T>  _L  T 

-  A  v6  v  A  u  — 


2k  u  » 


which  by  (46),  (47),  and  (57) 

.  JL  T  1  1 

-  A  -  v  2k  v  +u2ku 


-  A+v6_1vT  +  A+v6-1vT 


IT  IT 

A  -  v  2k  v  +  U  2k  u  H  B 


(A+A  -  A+v6-1vTA+) Ca+  -  A+A+v6-1vTA+  -  A+v6-1vTA+A+ 


+  A+v6  2(vTA+A+A+v)vTA+ 


20  - 
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aVa  »  k2bTA+b  ,  (aVb  +  1)  =  kbVb 
uTA+v  »  aTA+a  -  k2bVb  -  0  , 
vTA+v  -  aTA+a  +  k2bTA+b  -  2kaTA+b  =  2k  ,  and 
uTA+u  -  aTA+a  +  k2bTA+b  +  2kaTA+b  =  4aTA+a  -  2k 


A+  -  A+v6 


,+  x-1  T.+  X-1  ' 

^  vo  v  A  -  vo  v 


1  T.+.+ 
v  A  A 


x-2 ,  T.  +  .  +  .+  s  T.+ 

+  vo  (v  A  A  A  v)v  A 

-  V  Jk  vT*+  +  V  Jk  ''T*+a+v«‘1''IA+ 

+  V  i  vVv«-VaV  -  »  i.vVv6-2(vVAV,)vV 

-  £u  -  v6-1(vTA+A+u)3 (4aTA+a)  -  v6  ^ ( v T A+A+u )  }  T  A+ 

+  v  ^  vTA+^u  -  vd  ^(vTA+A+u)3(4aTA+a)  "  v<$  A  u)}TA 


,  1  T  +r  .-1,  T 

+■  v  v  A  (_u  -  vo  (v 


+  u  2k 


1  ta+  J_ 

2k  u  A  -  u  2k 


1  T.  +  .+  x-1  T.+ 
2^  u  A  A  vo  v  A 


1  T*+  T.+  .-1 r  --1,  T.  +  .+  *-\T.+ 

-  u  u  A  u(4a  A  a)  -  vo  (v  A  A  u) J  A 

aa+  *+  x-1  Ta+ 

AA  -  A  vo  v  A 

,  r  t,  T.+  »-l,,  1  .  T.+  .  1  T.+  ^  T.+ 

+  u(_-(4a  A  a)  (l-^4aAa  +  ^uA  u)Ju  A 

+  uC6_1(vTA+A+u)(4aTA+a)'1(l  -  ~  4aTA+a  +  uTA+u)}vTA+ 

+  vC6'1(vTA+A+u)(4aTA+a)"1(l  -  l))uTA+ 

+  v(]6-2  (vTA+A+u)  2  (4aTA+a) -1  (-1  +  l))vTA+. 


-  19  - 
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aVabVb  -  (aVb  +  l)2  ■*  aVa  -  kWb 

and  also  chat 

aTA+b  +  1  -  kb^A+b  k  *  (aTA+b  +  1)  /  bTA+b  . 
Note  also  that 

T  T  IT  IT 

B  »  A  +  ab  +ba  “A  +  u^u  -  v  v 

So  we  have 


(54) 


(55) 


(56) 


f  IT  1  T]f,+  A+A  +  b-1  T.+  A+  p-1  T.  +  .+ 

SG.Ia-v-v  +  u^u]|a  -  A  A  v6  VA  -Av6  vAA 


A+  *-2,  T.+.+.+  v  Ta+ 
+  A  vo  (v  A  A  A  v)v  A 


-  A+(u  -  v<5  1  (vTA+A+u)3  (4aTA+a)  -  v6  ^(vTA+A+u)3TA+| 

fa  1  T)/-.+  *+a+  x-1  Ta+  a+  jb-1  T.+  .+ 

[A-V2kVJCA  -AAv,S  VA  -AV<S  VAA 

+  A+v6~  ^ (vTA+A+A+ v) vTA+3 

-  A  -  v  vTjA+Cu  -  v6  ^(vTA+A+u)}(4a  A  a)  * 

•  (u  -  v6  1(vTA+A+u)}TA+ 


1  T  +  1  T.+.+  ~-l  T.+ 

+  u  —  u  A  -  u-tt-u  A  A  vo  v  A 
2k  2k 


1  Ta+  p~1  TA+A+ 
-  u  —  u  A  v£  vAA 
2k 


1  Ta+  .-2,  Ta+  +a+  a  Ta+ 
+  u  —  u  A  vo  (vAAAv)vA 
2k 


1  TA+r  x“l /  TA+A+  .v,  T  +  .-1 
-  u  —  u  A  (_u  -  vo  (v  A  A  u)  J  (4a  A  a) 


(u  -  v6-1(vTA+A+u)}TA+  . 


Now 


-  18  - 
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Theorem  4: 


If 


then 


and 


Pa  -  0  , 

Pb  -  0  , 

T  +  T  +  T  +  2 

a  A  ab  A  b  -  (a  A  b  +  1)  ®  0  , 

T  4- 

a  A  a  J  0  , 

T  + 

b  A  W  0  , 


Rank(B)  =  Rank(A)  -  1  , 


(46) 

(47) 

(48) 

(49) 

(50) 

(51) 


where 


B+  -  A+  -  aVvS'Va*  -  »VV»Y 

+  A+v6  2(vTA+A+A+v)vTA+ 


-  A+Cu  -  v<5  1  (vTA+A+u)}  (4aTA+a)  "'1(\i  -  v6-1  (vTA+A+u)]TA+ 


G  , 


(52) 


u  »  a  +  bk  , 
v  ■  a  -  bk  , 
T.+, 


k  »  (axATb  +  l)/bTA+b  ,  and 


A  T.+.+ 
o  ■  v  A  A  v  . 


Proof:  Note  first  that  (48),  (49)  and  (50)  imply  that 


aVb  t  -1  , 


(53) 


and  that 


N 


-  17  - 


T-493 


-  A+Ca(aTA+A+b)B'1  -  b>'ACa(aXA+A+b)  &~L  -  b^A 


-lr.  /  T.+.+,  vo-1  ."\T.+ 


by  (3), 


+  A+a8"1(l-l)aTA+A+  +  A+a6“2 (aTA+A+A+a) (l-l)aTA+ 
+  A+a8‘1C(aTA+A+a)(aTA+A+b)B"1  -  (aTA+A+b)>_1 
•  (a(aTA+A+b)B_1  -  b]V\ 


-  A+  -  A+A+a6_1aTA+  -  A+aB~1aTA+A+  +  A+aB~2 (aTA+A+A+a)aTA+ 
-  A+Ca(aTA+A+b)B_1  -  b} Y~ 1 (a ( aTA+A+b ) B~ 1  -  b]TA+ 

=  G  . 

Let  Q  =  I  -  BG  ,  which  by  (45) 

+  -1T  + 

-  P  +  A  aB  a  A  . 

Now  from  (37)  and  (38)  it  follows  that 

Bx  *  0  for  all  x  satisfying  Ax  «  0  , 


Rank(Q)  ^  Rank(P)  . 

Now  by  the  same  argument  as  in  Theorem  2, 


B(A  a)  =0  , 


AA  a  =  a  i*  0 


by  (37) .  So  it  follows  that 


and  by  (14)  that 


and  by  (15)  that 


Rank(Q)  >  Rank(P)  +  1 


Rank(Q)  ■  Rank(P)  +  1  , 


Rank(B)  «  Rank.  (A)  -  1  . 


-  16  - 
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M 

« 


T  T  +  +  +  —1  T  +  +  —1  T  +  + 

BG  ■  (A  +  ab  +  ba  )(A  -  A  A  aB  aA  -  A  aB  aAA 

+  A+a6_2(aTA+A+A+a) aTA+ 

-  A+Ca(aTA+A+b)B"1  -  b)y‘1Ca(aTA+A+b)B~1  -  b]TA+) 

AA+  a*+*+  a"1  Ta+  aa+  o-l  T  +  + 

“  AA  -  AA  A  aB  a  A  -  AA  ap  aAA 
+  AA+aB~2(aTA+A+A+a)aTA+ 

-  AA+Ca(aTA+A+b)B_1  -  b3y'1(a(aTA+A+b) B_1  -  b)TA+ 

*  wTa+  .Ta+a+  q-1  Ta+  .  Ta+  q-1  T.+.+ 

+  ab  A  —  ab  A  A  aB  a  A  -  ab  A  aB  aAA 

+  abTA+aB"2(aTA+A+A+a)aTA+ 

-  abTA+(a(aTA+A+b)B-1  -  b)y~1Ca(aTA+A+b) B"1  -  b}TA+ 

+  ba  A  -  ba  A  A  aB  a  A  -  ba  A  aB  aAA 

+  baTA+  aB  2 (aTA+ A+ A+ a>  aTA+ 

-  baTA+Ca(aTA+A+b)B'1  -  b)y-1Ca(aTA+A+b) B'1  -  b]TA+ 

*  AA+  -  A+aB_1aTA+  +  a(-3_1  +B-1)aTA+A+ 

+  aC(aTA+A+b)2B”V1(l-l)  +  (aTA+A+b)B-1(l-l)>TA+ 

+  aC(aTA+A+b)B"1Y'1(l-D  +  1  -  1>TA+ 

+  bC(aTA+A+b)B"V1(l-D  +  1  -  1>TA+ 

+  b(y  -  y  )b  A 
+  +  -1  T  + 

-  AA  -  A  aB  a  A  ,  (45) 

which  by  (4)  is  symmetric.  Note  that  G  is  symmetric.  Then  by  (13) 
and  (45)  it  follows  that 
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Theorem  3: 
If 


and 

then 


and 


Pa  *  0  , 

Pb  »  0  , 

T  +  T  +  T  4-  2 

a  A  ab*A  b  -  (axA  b+1)  -  0  , 

T  +  T  + 

a  A  a  -  0  ,  (b  A  b  *  0) 

bVb  *  0  ,  (aTA+a  jt  0) 

Rank(B)  «  Rank (A)  -  1  , 


B+  -  A+  -  A+  A+  a6~1aTA+  -  A+a8-1aXA+A+ 


,  .+  0-2  T  +  +  +  .  T,+ 
+  A  ag  (a  A  A  A  a)a  A 


-  A  (a(aTA+A+b)6  1  -  b}y  1(^a(aTA+A+b)3  1  -  b}TA+ 


G  , 


where 

and 


X  +  + 

8  ■  a  A  A  a  ,  and 
T  + 

Y  -  b  A  b  . 


(37) 

(38) 

(39) 

(40) 

(41) 

(42) 


(43) 


Proof:  Now  aTA+A+a  +  0  for  aTA+A+a  -  0  A+a  *  0  =■» 

■p  +  + 

Pa  ■  a  4  0  ,  a  contradiction.  Thus  a  A  A  a  has  an  inverse.  Note 
also  that  b  A  b  t  0  by  assumption,  and  hence  has  an  inverse  and  that 
by  (39)  and  (40), 


Now 


T  + 
a  A  b 


-1 


(44) 
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+  A+(a,b)c'1DC_1  %  A+  , 
b 


by  (33) 


=  G  . 


Let  A  ■  I  -  BG  ,  which  by  (36) 


P  +  A+(a,b)C_1  %  A+  . 

b 


Now  by  (34)  it  follows  that 


’  1 

Rank  ^A+(a,b)(f1  aT  A+^  -  2  . 


Hence  by  (14)  we  have 

Rank(Q)  *  Nullity(B)  <  Rank(P)  +  2  . 

Now  (24)  and  (25)  imply  that  Bx  *  0  for  all  x  satisfying 
Ax  *  0  ,  which  implies  Rank(Q)  >  Rank(P)  .  Now  B(A+a)  ■  0  . 


Proof: 


+  T+  +T++  +  +T  + 

(A  +  AA  ab  A  A  +  AA  ba  A  A)A  a  *  AA  a  +  AA  ab  A  a 

+  T  + 

AA  ba  A  a  , 


which  by  (27)  and  (33) 


AA  a  -  AA  a  »  0 


Similarly,  B(A  b)  ■  0  .  So  by  (24),  (25)  and  (34)  it  follows  that 


Rank(Q)  =  Rank(P)  +  2 


and  then  by  (15)  that 


Rank(B)  *  Rank (A)  -  2  . 


-  12  - 


T-493 


-  a(  +l)cf1if1(a  +  aTA+b  +  l)bTP 


T+  T  +  T+  -IT 

+  ba  A  -  b(a  A  a  +  a  A  b)C  b  P 


T  +  -1  T  4*  T 

-  ba  A  +  be  (a  +  axA  b  +  l)b  P 


AA+  +  (I  -  AA+)b?-1bTP 


(-1  r  _1  T  +  T  +  T  + 

C  C-l  +  O  A(a  +  a  Vb  +  1)  (1-1)  -  axA  b  -  bxA  b 

T+  T+  T+  Ot 

+  o  +  b  A  b  +  2  a  A  b  +  2  -  o  -  a  A  b  -  1J  b  P 

=•  AA+  +  Pb?_1bTP  ,  (67 

which  by  (4)  is  symmetric,  and  which  with  (13)  and  the  symmetry  of  G 

T 

and  B  implies  that  GB  »  (GB)  ,  and  (5)  holds.  Now 

BGB  »  (AA+  +  Pb£-1bTP) (A  +  abT  +  baT) 

=  AA+ A  +  AA+abT  +  AA+baT  +  Pb£bTPbaT 

=  A  +  abT  +  (I  -  AA+  +  AA+)baT  , 
by  (2),  and  (62), 

T  T 

=  A  +  ab  +  ba 


GBG  =  (A+A  +  PbC_1bTP) |a+  -  A+(a+b)C~XbTP 


-  Pb?-1(a+b)TA+  +  Pb((a+b)  V(a+b)  +  2)?"^bTP 

-  (A+a  -  Pb(a  +  aTA+b  +  IK"1}01  1  (]aTA+  -  C_1(a  +  aTA+b  +  l)bV)j 


A+AA+  -  A+AA+(a+b)C*'1bTP  -  A+AA+acT1(aTA+  -  if1  (a  +  aXA+b  +  l)bTP) 


-  PbC~‘VPb(a+b)TA+  +  Pbif3bTPb((a+b)  V(a+b)  +  2>1P 
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Pb?_2bTPb(a  +  aTA+b  +  l)cf1CaTA+  -  ?_1(ct  +  aTA+b  +  l)bTp}, 


which  by  (2), 


A+  -  A+(a+b)C_1bTP  -  Pb;-1(a+b)TA+ 
•  vT,+  ,  ..  v  T_ 


+  Pb?"  C<a+b)  A  (a+b)  +  2>TP 

-  (A+a  -  Pb(a  +  aTA+b  +  lK“1}a~1(aTA+  -  ?~1(a  +  aTA+b  +  l)bTp) 


Let  Q  «  I  -  BG  .  Then  by  (67), 


and  by  (14) , 


Q  -  P  -  PbC_1bTP 


Rank(Q)  >  Rank(P)  -  1  . 


We  also  have  by  (63)  that 


b  e  Range (B)  but  b  t  Range (A)  . 

Note  also  that  x  e  Range(B)  for  all  x  e  Range(A).  Hence 


Rank(B)  S*  Rank(A)  +  1  . 


But  (15)  and  (68)  give 


so  it  follows  that 


Rank(B)  Rank(A)  +  1  , 


Rank(B)  =  Rank(A)  +  1  . 


Theorem  6: 


Pa  =  0  , 
Pb  +  0  , 
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Proof:  Note  first  the  following: 

T  T 

(i)  From  (70)  it  follows  that  b  Pb  ■  b  PPb  >  0  and  thus  has  an  inverse. 

’ 

(ii)  DC  =*  A  +  u  y  wT  CA+  -  Pb(bTPb)_1uTA+  -  A+u(bTPb)“1bTP 

+  Pb(bTPb)~2(uTA+u  +  2)bTP) 

■  AA+  -  AA+u(bTPb)_1bTA'f  +  u  j  uTA+ 

-  u  j  uTPb (bTPb ) _1uTA+  -  u  y  uTA+u(bTPb)bTP 
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+  u|  uTPb(bTPb)“2(uTA+u  +  2)bTP 
=  AA+  -  AA+u(bTPb)_1bTP 

-  u  j  uTA+u(bTPb)_1bTP  +  u|  (uTA+u  +  2)  (bTPb)_1bTP 

-  AA+  +  (I  -  AA+)  u^^b)'^1? 

+  T  -1  T 

-  AA  +  Pb(b  Pb)  b  P  , 

T  T 

which  by  (5)  is  symmetric.  Now  from  C  =  C  and  D  =  D 
and  (75),  it  follows  that  DC  =  CD  =  (CD)^  and  (4)  holds. 

DCD  =  (AA+  -  pb(bTPb)-1bTp}(A  +  u  j  uT) 

+  +1T  T-1T1T 

»AAA+AAuju  -  Pb(btPb)  b  Pu  ~  u  , 

which  by  (2)  and  (69) 

.  .  AA+  1  T  _.  1  T 
=  A  +  AA  u  —  u  -  Pb  y  u 

=  A  +  (I  -  AA  +  AA+  )u  uT  , 

by  (69) 

1  T 

-A+uyu  =D. 

And 

CDC  *  [A+  -  Pb(bTPb)_1uTA+  -  A+u(bTPb)_1bTA+ 

+  Pb(bTPb)'2(uTA+u  +  2)bTP][AA+  -  Pb(bTPb)_1bTP] 

-  A+AA+  -  Pb(bTPb)-1uTA+AA+  -  A+u(bTPb)_1bTA+AA+ 

-  Pb (bTPb ) ~ 2 (uTA+u  +  2)bTPb(bTPb)-1bTP  , 
which  by  (3) 


(75) 

(13) 

Then 
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+  T  -lT-f  +  T  -1T  + 

-  A  -  Pb (bAPb)  uA  -  Au(b  rb)  Va 

T  -2  T  +  T 

-  Pb(b  Pb)  (u  A  u  +  2)b  P  =  C  . 

Thus  C  -  D+  .  Let  R  =  I  -  DD+  .  Then  by  (75) 

R  -  P  -  Pb^PbrH1?  , 
and  by  the  same  arguments  as  in  Theorem  5, 
Rank(D)  =  Rank  (A)  +  1  . 

(iii)  (I  -  DD+)v  -  v  -  AA+v  +  Pb(bTPb)_1bTPv 

=  (I  -  AA+  -  I  +  AA+)v  =  0  , 

T  +  + 

so  v  D  D  v  4  0  t  since 


(76) 


•  D+v  =  0  (I  -  DD+)v  =  v  ^  0  , 

X  +  + 

a  contradiction.  Thus  v  D  D  v  has  an  inverse, 
(iv)  vTD+v  *  vTA+v  +  2  u^A+v  +  uTA+u  =  4aTA+a  +2=2 


(77) 


Now 


BG 


f.  ,  IT  1  t)  /•_+  _+_+  ,  +  +  .-1  T  + 

A+u-ju  -  v  |  v  HD  -  DDv  (vD  D  v)  v  D 

+  .  T_+_+  .  ~1  T  +  +  +  ,  T  +  +  .  —2  ,  T_+_+_+  v  T  +~\ 

-  D  v(v  DDv)  vDD  +D  v(v  DDv)  (v  D  D  D  v)v  D  J 


■  D  -  v  -j  vT  Q)+  -  D+D+v(vD+D+v)  ^vTD+ 

-  D+v(vTD+D+v)-1vTD+D+  +  D+v(vTD+D+v)"2(vTD+D+D+v)vTD+3 
«  DD+  -  DD+D+v(vTD+D+v)_1vTD+ 

-  DD+v(vTD+D+v)'1vTD+D+  +  DD+v(vTD+D+v)-2(vTD+D+D+v)vTD+ 

-  v  y  vTD+  +  vT  ^  (vTD+D+v)(vTD+D+v)~1vTD+ 
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►  . 


+  v|  (vTD+v)  (vTD+D+v)"1vTD+D+ 

-  v  ±  (vVv)(vTdVv)'2(vVdVv)vV 


DD+  -  dWdVW 

-  v(vTD+D+v)  'LvTD+D+  +  v(vTD+D+v)-2(vTD+D+D+v)vTD+ 
*v|  vTD+  +  vT  ~  vTD+  +  v(vTD+D+v)‘1vTD'fD+ 

-  v(vTD+D+v)~2(vTD+D+D+v)vTD+ 

DD+  -  D+v(vTD+D+v)_1vTD+  , 


(78) 


which  by  (4)  is  symmetric.  Since  B  -  BT  ,  G  *  GT  and  BG  = 

T 

(BG)  ,  then  by  (13)  it  follows  that  GB  »  BG  *  (GB)T.  ,  and  (5) 
holds .  Then 

BGB  ■  (j)D  -  D+v(v^D+D+v)  (D  -  v  y  v^) 


i+D  -  DD+v  4  vT  -  D+v(vTD+D+v)"1vTD+D 


DD 


+  D+v(vTD+D+v)"1(vTD+v)  |  vT 


n  1  T 

D  -  v  —  v 


=  B  . 


And 


GBG  -  [D+D  -  D+v(vVd+v)'1vV][D+  -  dVv(vTD+D+v)‘W 


-  D+v(vTD+D+v)_1vTD+D+ 

+  D+v(vTD+D+v)“2(vTD+D+D+v)vTD+) 
D+DD+  -  D+DD+D+v(vTD+D+v)_1vTD+ 


-  29  - 


I 
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+  +  T++  -1T  +  + 

-  D  DD  v(v  D  D  v)  v  D  D 

+  +  T  +  4-  -9  T  +  +  +  T  + 

+  D  DDv(vDDv)  (v  D  D  D  v)v  D 

-  D+v(vTD+D+v)_1vTD+D+ 

+  D+v(vTD+D+v)“2(vTD+D+D+v)vTD+ 

+  D+v(vTD+D+v)"2(vTD+D+v)vTD+D+ 

-  D  v(vAD  D  v)  (vVdv) (vDDDv)vD 

+  „+  +  .  1^+  N-1  T_+ 

D  -DDv(vDDv)  vD 


+  T++  -1T++ 

-  D  v(v  D  D  v)  vD  D 


+  T++  -2  T+++  T  + 

+  Dv(vDDv)  *(vAD  D  D  v)vAD 


5  G  . 


Let  Q  -  I  -  BG  .  Then  by  (78)  Q  =  R  +  D+v(vTD+D+v)  W  , 
which  with  (15)  implies  that 

Rank(Q)  <  Rank(R)  +  1  . 

Now  B(D+v)  »  (D  -  v  ~  vT)D+v  ,  which  by  (76)  and  (77) 

“  v  -  v  =  0  . 

It  also  follows  from  (76)  that  Bx  =  0  for  all  x  satisfying 
Dx  =  0  and 


D(D+v) 


v  ^  0  . 


Hence 


Rank(Q)  =■  Rank(R)  +  1 
which  with  (15)  implies 


Rank(B)  *  Rank(D)  -  1  ■  Rank(A)  . 


Theorem  7: 


If 


and 

then 


Pa  ^  0  , 

Pb  *  0  , 

Pa  j  Pbk  for  any  k  #  0  , 


and 


and 


Rank(B)  =  Rank (A)  +  2 


“ 

f 

rV 

- 

-1 

t' 

+ 

1 

a 

1 

a 

■A  -  P(a,b) 

,T 

P  (a, ) 

,  T 

[b  J 

ib  J 

-  A+ (a,b) 


- 

r  \ 

T 

- 

-1 

t' 

1 

a 

1 

a 

.t 

P(a,b) 

,  T 

_ 

lb  J 

__ 

lb  J 

+  P(a,b) 


r 

a 


hT 


vlr 


P(a,b) 


A  (a,b)  + 


B3 


P  (a. 


=  G  . 


Proof:  Let 


P(a,b) 


[:j] 


T 

a 

.  T 

_ 

lb  J 

A+(a,b)  + 


0  1 
1  0 


Note  first  that  (79),  (80)  and  (81)  imply  that  det  C  = 


T  T 
a  Pa  b  Pb 


T  2 

(a  Pb)  0  and  hence  C  has  an  inverse.  Now 
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BG  -  A  +  (a,b)F 


A  -  P (a,b)C 


T 

-1  a1  .+ 


-1-1  a 


-  A  (a,b)C  P  +  P(a,b)C  DC 


+  +  -la 

AA  -  AA  (a,b)C  „ 


T 

+  (a,b)F  aT  A+  -  (a,b)F 


t! 

P(a,b)  C"1  a  A+ 

J  lb1] 


T 

-  (a,b)F  3  A  (a.b)c' 
b 


P  +  (a,b)F  P(a,b)  C  DC 


-1^-1  a J 


T  T 

AA+  -  AA+(a,b)C_1  *  P  +  (a,b)F  a  A+ 


T  J 

-  (a,b)F  aT  A  -  (a,b)F(D-F)C* 


+  (a,b) F  D  C' 


+  +  -la 

AA  -  AA  (a,b)C  „ 


P  +  (a,b)F  F  C' 


AA+  +  (I-AA+ ) (a,b)C_1  * 


since  FF  ■  I 


+  -la 

AA  +  P(a,b)C  _ 


which  by  (4)  and  the  symmetry  of  C  is  symmetric.  Now  since  G  is 


symmetric,  then  by  (13)  and  (56) 


BG  =  GB  -  (GB)  so  (5)  holds. 
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BGB  =>  AA  +  P(a,b)C 


VJpJLA  +  (a>b)FMJ 


.  T  1  T  T 

AA  A  +  AA  (a, b)F  3  +  P(a,b)C_±  3  P(a,b)  F  3 

b  I  b  b 


,  T  T 

A  +  AA+(a,b)F  3T  +  P(a,b)F  3T 
b  b 


A  +  (AA+  +  I  -  AA+)(a,b)F  3 


-  A  +  (a,b)F 


i  B  . 


™  — 

T 

3BG  =  A+A  +  P(a,b)C-1  3  P 

L  1“  J  . 

T 

•  A+  -  P(a,b)C_1  3  A+  -  A+(a, 

lb 


-1  a  -1 

b) C  P  +  P (a,b) C  DC 

b 


T  T 

-  A+AA+  -  A+AA+(a,b)C_1  a  P  -  P(a,b)C_1  a  P(a,b)  C~l 

b  J  Ll«>TJ  J  [ 

x  x' 

+  P(a,b)c'1  aT  P(a,b)  c'V-1  3T  P 

-lb  J  ib  a 

x  x]  • 

=  A+  '  A+ (a»b)C  1  a  P  -  P (a,b)C_1  3  A+  +  P(a,b)C-1DC-1  3 


5  G  . 


I  -  BG  .  Then  by  (84) 


Q  =  P  -  P (a,b)C-1  3  P  . 


From  (81)  it  follows  that 


P(a,b)C  1 


P  =  2 


and  then  by  (14) 


Rank(Q)  >  Rank(P)  -  2 


Now  Px  =  0  Qx  *  0  .  Note  also  by  (79)  and  (80) 

p.pa  =  Pa  /  0 


P*Pb  =  Pb  #  0 
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QPa  =  Pa  -  P(a,b)C 


T 

-1  a  Pa 


and  similarly 


-  Pa  -  (Pa.Pb)  o=0. 


QPb  =  0  . 


Then  by  (81)  it  follows  that 


Nullity (Q)  >  Nullity (P)  +  2  , 


which  with  (14)  implies 


Rank(B)  =  Rank(B)  +  2 


Theorem  8: 


Pa  4  0  , 

Pb  4  0  , 

Pa  =  Pbk  for  some  k  ^  0  , 
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(a-bk) TA+ (a-bk)  -  2k  ^  0 

then 

Rank(B)  =  Rank(A)  +  1 

and 

B+  =•  A+  -  A+vA_1vTA+  -  PaljfV1^*  +  bka))TA+ 

+  -1  -1  T 

-  A  (at  +  bkw)ti>  A  a  P 

+  Paij;“2A'1k2CaTA+abTA+b  -  (aXA+b  +  l)2}aTP 
-  G  , 

where 

T  T 

a  Pa  =  a  Pb 
k  =  -  T  * 

a  Pb  b  Pb 

v  =  a  -  bk  , 

T  + 

A  =*  vxA  v  -  2k  , 

T 

ip  =  a  Pa  , 

t  =»  k2bVb  -  k  (aXA+  b  +  1)  , 

and 

T  +  T  + 

uj  =  a  A  a  -  k(a  A  b  +  1)  . 

Proof :  Let  u  *  (a  +  bk) .  Note  the  following: 

T  T 

(i)  From  (85)  it  follows  that  a  Pa  =  a  PPa  >  0  and  from 
follows  that  A  ^  0  and  so  each  has  an  inverse. 

(ii)  A+  (at  +  bkw)  2 

=  A+(aQc2bXA+b  -  k(aXA+b  +  1)3  +  bk(aXA+a  -  k(aXA+b  + 

-  A+(a(l  -  A_1(aXA+a  -  k2bXA+b)3  +  bkCl  +  A_1(aXA+a  - 

-  A+u  -  A+vA'Va+u  -  (A+  -  A+vA_1vXA+)u  . 
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(88) 

(89) 

(90) 


(88)  it 

1)3) 2A-1 
k2bXA+b)3) 
(91) 
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(iii)  From  (87)  it  follows  that 


and 


v  P  =  0  , 


T  T 

u  P  -  2a  P  , 


■f  + 

AA  v  =  A  Av  =  v 


(iv)  (A  ~  v  ~2k  vT^A+  ~  A+vX_1vTA+) 

■  AA+  -  vA-1vTA+  -  v  ~  vTA+  +  v  (vTA+v)X-1vTA+ 

-  AA+  -  v(A_1  +  ±  A-1vTA+v)vTA+ 

/ 

=  AA+  +  v(A  1  (vTA+v  -  2k  -  A)}vTA+ 


(92) 


(v) 


=  AA 


T  +  T  +  ? 

Au  A  u  -  (u  A  v)  +  2kA 


(93) 


=  (a  A+a  +  k  bTA+b)2  -  4k2(aTA+b)2  -  2k(aTA+a  +  k2bTA+b  +  2kaTA+b) 
-  (aTA+a)2  -  (k2bTA+b)2  +  2k2aTAabTA+b 
+  2k(aTA+a  +  k2bTA+b  -  2kaTA+b)  -  4k2 
*  4k2(aTA+abTA+b  -  (aTA+b)2  -  2aTA+b  -  l} 

=  4k2 (]aTA+abTA+b  -  (aTA+b  +  l)2}  .  (94) 


Now 


BG  =  [A  -  v  ^  vT  +  u  ±  UT] [A+  -  A+vA_1vTA+ 


2k 


-  Pa4)  1A  1(ax  +  bkw)TA+  -  A+(ax  +  bku))^_1A-1aTP 
+  Paip  2A  1k2(aTA+abTA+b  -  (aTA+b  +  l)2}aTP] 
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1  T 

D  =  A  +  u  2k  U  ’ 

Rank(D)  =  Rank (A)  , 

and  D+  is  given  by  Formula  (106) .  Now  by  (19) ,  Rank(B)  = 

Rank (A)  ,  which  will  occur  if  and  only  if 

(I  -  DD+)v  =  0  and 

v^d"*"v  ^  -2k  . 

By  the  interlocking  eigenvalue  property,  B  will  remain  positive 
semidefinite  if  and  only  if 

v^D+v  <  2k  •4-^  4k2 [a^A+ab^A+b  -  (a^A+b  +  l)2]  <  0 

<=»  aTA+abTA+b  -  (aTA+b  +  l)2  <  0  . 


and 

then  B  will  be  indefinite. 


Pa  =  0 
Pb  *  0  , 


T  + 

Proof:  By  Lemma  1,  a  A  a  >  0  so  the  conditions  of  Theorem  5 

hold.  Define 

u  =  a  +  kb 
v  =  a  -  kb 
1  T 

for  some  k  >  0  .  Then  u  -^r  u  is  a  positive  dyad,  Pu  ^  0  , 

1  T 

D  *  A  +  u  —  u  will  be  positive  semidefinite,  and  Rank(D)  =  Rank(A)  +  1 
2k 

which  will  occur  if  and  only  if 
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will  be  posi- 


(ii) 


u  -jk  u  is  a  positive  dyad  and  D  =  A  +  u  u 
tive  semidef inite.  Note  also  that  1  +  —  u  A  u  >  0  ,  which  with 

Theorem  10  implies  that  Rank(D)  =  Rank(A)  and  D+  is  given  by 

Formula  (106).  By  (51),  Rank(B)  =  Rank(A)  -  1  ,  which  will  occur 

if  and  only  if 

(I  -  D+D)v  =  0  and 
T  + 

v  D  v  =  -2k  . 

Now 

VTD+V  a  VTA+V  -  (vTA+u)2(2k  +  wTA+u)-1  =  2k 

(vTA+v  -  2k) (2k  +  uTa+u)  -  (v?A+u)2  =  0 
4k2(-2aTA+b  -  1)  +  (aTA+a  +  k2bTA+b)2 
-  (2kaTA+b)2  -  (aVa  -  k2bTA+b)2  =  0 
4k2[aTA+abTA+b  -  (aTA+b  +  l)2]  =  0 

T  4*  T  4*  T  4-  ? 

a  A  ab  A  b  -  (a  A  b  +  1)  =  0  . 


IT  IT 

If  k  <  0  ,  the  roles  of  u  —  u  and  v  -  —  v  as  positive 

2k  2k 

and  negative  dyads  are  reversed,  and  the  same  result  obtains. 

T  +  T  +  T  +  2 

Suppose  a  A  ab  A  b  -  (a  A  b  +  1)  <0.  Then  the  conditions  of 


Theorem  1  hold. 

Define 

u  = 

(a  +  bk) 

and 

v  = 

(a  -  bk) 

for 

some  k  >  n  . 

As  in  part  (i). 

1  T 
U2k  U 

is  a 

positive  dvad. 

1  T  + 

1  +  2k  u  A  u  >  0  ,  and  for 
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Now  Pa  =  0  ,  a  ^  0  a  =  E*w  ,  where  E*  =  [e^,...»e^]  is  the 

n  x  k  matrix  of  eigenvectors  of  A  associated  with  nonzero  eigenvalues, 

T 

and  w  is  the  k  x  1  vector  whose  ith  element  is  X^*e^a  *  *  =  l»***>k 

Then 

T  +  T  T  +  T 

a  A  a  =*  w  (E*)  EX  E  E*w 

=  wT[Ik,0]X+[Ik,0]Tw 

=  w^(X*)+w  , 

where  X*  is  the  positive  definite  k  x  k  diagonal  matrix  of  nonzero 
eigenvalues  of  A  ,  giving 

T  4- 

a  A  a  >  0  - 


Corollary  1: 
If 


and 


Pa  =  0  , 


Pb  =  0 


then  a  necessary  and  sufficient  condition  for  B  to  be  positive  semi- 
definite  is  that 

a  A  ab  A  b  -  (aAA  b  +  1)  <  0  . 


Proof:  There  are  two  cases. 

T  +  T  +  T  +  2 

(i)  Suppose  a  A  ab  A  b  -  (a  A  b  +  1)  =0.  Then  by  Lemma  1,  the 

conditions  of  Theorem  4  hold.  That  is,  conditions  of  Theorems  2 
and  3  cannot  hold  for  A  positive  seraidef inite. 

Define  u  ,  v  ,  and  k  as  in  Theorem  4.  If  k  >  0  ,  then 
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will  equal  the  rank  of  A  .  In  either  of  the  above  cases,  B 
will  remain  positive  semidef inite. 

T  +  - 

For  values  of  c  less  than  the  above,  that  is,  if  c  <  -(a  A  a) 
the  new  eigenvalue  will  shift  below  zero,  rendering  B  indefinite. 

Suppose,  as  in  the  process  of  building  an  estimate  of  the  posi¬ 
tive  part  of  a  matrix,  it  is  desired  that  B  remain  positive  semidefi- 
nite.  Then  by  the  reasoning  above,  we  see  that  in  the  case  that  c  < 

-(a  A  a)  ,  a  fraction  of  the  dyad,  namely  ada  for  any  -(a  A  a)  ^ 
d  <  0  ,  could  still  be  added  to  A  ,  and  B  would  remain  positive  semi- 
definite. 

It  will  next  be  useful  to  examine  the  effect  on  the  definiteness 

T  T 

of  a  matrix  of  a  rank  two  perturbation  of  the  form  (ab  +  ba  )  .  This 

T  T 

effect  can  readily  be  demonstrated  by  regarding  (ab  +  ba  )  as  the 
successive  sum  of  two  —  one  positive  and  one  negative  —  symmetric  rank 
one  perturbations. 

As  before,  let  A  be  an  n  x  n  symmetric  positive  semidef inite 

T  T 

matrix  and  let  a  and  b  be  n  x  1  vectors.  Let  B  =  A  +  ab  +  ba 
and  P  =  I  -  A+A  . 

Lemma  1: 

If  Pa  =  0  ,  a  ^  0  ,  then  aTA+a  >  0  . 

T 

Proof:  A  positive  semidef inite  implies  A  =  EXE  ,  where  E  is 

T 

the  n  x  n  matrix  of  eigenvectors  of  A  ,  E  E  =  I  ,  and  X  is  the 

n  x  n  diagonal  matrix  of  eigenvalues  of  A  ,  where  the  X^s  are 

ordered  so  that  X  >  X_  ^  . . .  >  X 
12  n 
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(i)  If  c  is  a  positive  scalar,  then  depending  on  whether  Pa  =  0 

T 

or  not,  the  rank  of  B  =  A  +  aca  will  remain  the  same  or  in¬ 
crease  by  one.  In  either  case  the  eigenvalues  of  A  will  shift 
in  a  positive  direction  and  B  will  remain  positive  semidef inite. 

(ii)  If  c  is  a  negative  scalar  and  if  Pa  ^  0  (this  can  only  happen 

if  A  is  not  of  full  rank  and  therefore  has  at  least  one  zero 

eigenvalue),  then  by  the  interlocking  eigenvalue  property  one  of 
the  zero  eigenvalues  of  A  will  decrease  and  become  negative, 
leaving  B  indefinite. 

(iii)  If  c  is  a  negative  scalar  and  if  Pa  =  0  ,  then 

+  T 

B  =  A  +  AA  aca 

and  all  elements  of  the  null  space  of  A  are  elements  of  the 
null  space  of  B  .  In  particular,  all  eigenvectors  associated 
with  the  zero  eigenvalue  for  A  ,  if  any,  will  also  be  so  for  B  . 
Now  for  a  ^  0  ,  there  exists  some  smallest  eigenvalue  of  A  of 
multiplicity  H  whose  associated  eigenvectors  are  not  all  orthog¬ 
onal  to  a  .  Then  by  the  interlocking  eigenvalue  property,  this 
eigenvalue  (or  one  of  these  if  H  >  1)  will  decrease  to  a  value 

8  which  solves  aTE(A-Bl)+ETa  =  -  —  ,  where  A  =  EAET  is  the 

c 

eigenvalue-eigenvector  decomposition  of  A  .  In  particular,  if 

T  -f  -i 

the  scalar  c  satisfies  c  =  -(a  A  a)  ,  then  the  new  eigenvalue 
8  will  be  zero  and  the  rank  of  B  will  be  one  less  than  the 
rank  of  A  .  For  values  of  c  greater  than  the  above, 
the  new  eigenvalue  will  be  positive  and  the  rank  of  B 
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(ii)  If 


and 


then 


and 


Pa  -  0 


T  + 

1  +  ca  A  a  =*  0  , 


Rank(B)  =  Rank (A)  -  1 


B+  -  A+  -  A+A+a6  1aTA+  -  A+a0-1aTA+A+ 


+  A+a8~2(aTA+A+A+a)aTA+ 


T  +  + 

where  8  *  a  A  A  a 


(iii)  If 


then 


and 


Pa  t  0  , 


Rank(B)  =  Rank(A)  +  1 


(107) 


B+  *  A+  -  PaY_1aTA+  -  A+ay_1aTP  +  Pay'2(c  1  +  aTA+a}aTP  ,  (108) 


where  Y  *  a  Pa 


Following  the  above  results  and  the  interlocking  eigenvalue  theo 

rein  [see  McCormick  (1983)]  we  can  make  the  following  observations: 

Suppose  A  is  an  n  x  n  symmetric,  positive  semidefinite  ma- 

T 

trix  which  is  perturbed  by  a  dyad  of  the  form  aca  where  a  and  c 
are  defined  as  in  Theorem  10.  Let  P  *  I  -  AA+  . 
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3.  Computing  an  Estimate  of  the  Positive  Part 
of  a  Symmetric  Matrix  and  Directions  of 
Nonpositive  and  Negative  Curvature 

The  results  of  the  previous  section  can  be  directly  applied  in  de¬ 
termining  the  definiteness  of  a  matrix  A  which  is  given  by  (1) ,  and 
in  turn  computing  an  estimate  of  the  positive  part  of  A  and  its  asso¬ 
ciated  directions  of  nonpositive  and  negative  curvature. 

It  will  first  be  useful  to  state  the  following  results  concerning 
symmetric  rank  one  perturbations  due  to  Meyer  (1973)  and  McCormick 
(1976).  Statements  and  notation  are  as  in  McCormick  (1976). 


Theorem  10: 

Let  A  be  an  n  x  n  symmetric  matrix,  a  an  n  x  1  vector, 
and  c  a  nonzero  scalar.  Define 


(i)  If 

and 

then 


P  =  I  -  AA+  and 
B  =■  A  +  acaT  . 


Pa  =  0 

1  +  ca^A+a  /  0  , 


Rank(B)  =  Rank(A) 

and 


B  =  A  -  A  a(c  1  +  aTA+a3  1aTA+ 


(106) 
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Let  Q  -  I  -  BG  .  Then  by  (105) 

+  T  +  +  -1T+ 

Q  *  R  +  D  v(v  D  D  v)  v  D 

and 

Rank(Q)  <  Rank(R)  +  1 

by  (14).  It  follows  from  (104)  that  Bx  =  0  for  all  x 
fying  Dx  *  0  .  Hence 

Rank(Q)  ^  Rank(R)  . 

Now  B(D+v)  -  (D  ~  v  vT)D+v 

-  DD+v  -  v  vTD+v  ,  which  by  (99)  and  (102) 
»  v  -  v  =  0  . 

But  DD+v  ■  v  0  by  (102) ,  so  we  have 
Rank(Q)  =  Rank(R)  +  1 
which  with  (15)  gives 

Rank(B)  *  Rank(D)  -  1  =■  Rank(A)  . 


satis- 
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Nullity (R)  >  Nullity  (P)  +  1 


Rank(R)  =  Rank  P  -  1 


Rank(D)  =  Rank (A)  +  1  . 


(I  -  DD+)v  =  v  -  AA+v  +  Pa(a^Pa)  ^a^Pv  =  v  -  v  =  0  , 


(104) 


by  (102).  So  VTD+D+V  i  0  since  D+V  =  0  (I  -  DD+)v  -  v  t  0  , 

T  +  + 

a  contradiction.  Hence  v  D  D  v  has  an  inverse.  Now 

BG  -  tA  +  uT  -k  u  -  v  -k  vT]  *  G 

=  [0  -  v  ^  VT][D+  -  D+D+v(vTD+D+v)-1vTD+ 

-  D+v(vTD+D+v)_1vTD+D+ 

+  D+v(vTD+D+v)'2(vTD+D+D+v)vTD+] 


»  DD+  -  D+v(vTD+D+v)-1vTD+  , 
by  the  same  process  as  in  Theorem  6,  and 


(105) 


BG  =  (BG)  ‘ 


by  (4).  So  we  have  by  B  =  B  ,  G  =  G  ,  BG  -  (BG)  and  (13) 

T 

that  GB  *  BF  ■  (GB)  .  And  by  the  same  arguments  as  in  Theorem 

1  T 

6,  we  have  BGB  “  D  “  v  v  =  B  »  30(1 

+  ++  T  +  +  -1T  + 

GBG  =  D  -  D  D  v(v  D  D  v)  v  D 

-  D+v(vTD+D+v)_1vTD+D+ 


+  D+v (vTD+D+v) "2 (vTD+D+D+v) vTD+ 
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=»  A  +  u  uT(AA+  +  I  -  AA+ )  , 

by  (2),  (9),  and  (98), 

1  T 

=  A  +  u  —  u  5  D  , 

and 

CDC  “  CAA+  +  Pa(aTPa)_1aTP3 |a+  -  Pa(2aTPa)_1uTA+ 

-  A+u(2aTPa)_1aTP 

+  PaCk(aTA+b  +  1)} (aTPa)_2aTP 

; 

+  +  +  +  T  -IT 

-  AA  A  -  AA  A  u(2a  Pa)  aP 

T  -IT  T  _1  T  4- 

-  Pa(a  Pa)  aiPa(2aiPa)  u  A 

+  Pa(aTPa)_1aTPaCk(aTA+b  +  1)3 (aTPa)~2aTP  , 
which  by  (3),  and  (9) 

-  A+  -  A+u(2aTPa)~1aTP  -  Pa(2aTPa)-1uTA+ 

+  PaCk(aTA+b  +  1)3 (aTPa)-2aTP  =  C  . 

Thus  C  -  D+  .  Let  R  ■  I  -  DD+  .  Then  by  (103), 

R  -  P  -  Pa(aTPa)-1aTP 

and 

Rank(R)  >  Rank  P  -  1  . 

Note  that  Rx  =  0  for  all  x  satisfying  Px  =  0  .  Now  by  (96) 
and  (97),  P(Pu)  =  Pu  i  0  ,  but 

R(Pu)  =  Pu  -  Pa(aTPa)-1(aTPa)  2 
*  0  by  (102)  , 

which  implies 
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'A  T  'A  L".  T  'A  ~ 


+  +  T  -1  T 

AA  -  AA  u(2a  Pa)  a  P 

+  u  ^  uTA+  -  u  uTPa(2aTPa)_1uTA+ 


1  T  +  T  -IT 
-  u  u  A ^u(2a1Pa)  a  P 
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+  u  uTPaCk(aTA+b  +  l)}(aTPa)  aTP 


+  +  T  -1  T 

AA  -  AA  u(2a  Pa)  a  P 


+  u 


_1_  _1_ 

2k  "  2k 


Ta+ 
u  A 


+  u 


-^(-uTA+u(2aTPa)-1  +  4k(aTA+b  +  1) (2aTPa)"1}] aTP 


Now  u^A+u  ■  aTA+a  +  k2b^A+b  +  2k(a^A+b)  ,  and  by  (99)  it  fol¬ 
lows  that 

aTA+a  +  k2bTA+b  *  2k(aTA+b  +  1)  =»  uVu  =  4kaTA+b  +  2k 
So 


+  +  T  -1  T 

DC  =  AA  -  AA  u(2a  Pa)  a  P 


+  u 


-  (2aTPa)_1C4k(aTA+b  -  aVb)  +  2k)laTP 


=  AA+  +  (I  -  AA+)a(a^Pa)  ^a^P 


+  T  _i  t 

AA  +  Pa(a  Pa)  a  P  , 


(103) 


which  by  (5)  is  symmetric.  Note  also  that  C  =  C  and  D  =  DJ 
Then  from  (13)  and  (103)  it  follows  that 

DC  =  CD  =  (CD)T 

and  (4)  holds.  Then 


DCD 


.  ,  IT 
A  +  n-u 


CAA+  +  Pa(aTPa)_1aV) 


+  1T+  IT  T  —IT 

AAA  +  u  u  AA  +  u  ^  uAPa(a  Pa)  Aa  P 
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then 


and 


where 


and 


Rank(B)  =  Rank(A) 


B 


=  D+  -  dVv(vTdVv)-W 


-  D+v(vTD+D+v)-1vTD+D+ 

+  D+v (vTD+D+v ) " 2 (vTD+D+D+v) vTD+ 


G  , 


k 

u 

v 


T  T 

a  Pa  _  a  Pb 

T  “  t  » 

a  Pb  a  Pb 
a  +  bk  , 
a  -  bk  , 


D  = 


A  + 


+  +  T  -1  T  + 

D  -  A  -  Pa(2a  Pa)  u  A 

+  T  -1  T 
-  A  u(2a  Pa)  a  P 

+  Pa(k(aTA+b  +  1)} (aTPa)-2aTP  =  C  . 


Proof:  Note  first  the  following: 

T  T 

(i)  From  (96)  it  follows  that  a  Pa  =  a  PPa  >  0  and  so  has  an 

T  f 

(ii)  From  (98)  it  we  get  u  Pa  *  2a  Pa  ,  and  Pv  =  0 


T  T 

a  Pa  =  2a  Pa  and  Pv 


(iii)  DC 


.  ,  IT 
A+U  2kU 


(A+  -  Pa(2aTPa)"1uTA+  -  A+u(2aTPa)*1aTP 
+  Pa(]k(aTA+b  +  1)}  (aTPa)'2aTp) 


(100) 


(101) 


inverse. 


(102) 
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+  Pu  ~  ^~2A*1k2CaTA+abTA+b  -  (aTA+b  +  1) 2}aTP 
-  A+  -  A+vA-Va+  -  (A+  -  A+vA-1vTA+)u  j  *“V1aTP 
-  Pa  i  !|r1X_1uT(A+  -  A+vA'1vTA+) 

+  Pa^'2X“1k2CaTA+abTA+b  -  (aVb  +  l)2}aTP 


Let  Q  -  I  -  BG  .  Then  by  (95), 

Q  -  P  -  Pu(uTPu)-1uTP  , 

and  by  (14) 


Rank(Q)  >  Rank(P)  -  1  . 

Now  P(Pu)  *  Pu  /  0  by  (86)  and  (87),  but 

Q(Pu)  =  Pu  -  Pu(uTPu)-1uTPu  *  0  . 

Qx  “  0  for  all  x  satisfying  Px  *  0  .  Hence 
Nullity  (Q)  ^  Nullity  (P)  +1  ,  which  implies 
Rank(Q)  =  Rank(P)  -  1 

which  gives 


Rank(B)  =  Rank(A)  +  1  . 


Theorem  9: 
If 


and 


Pa  =  Pbk 


Pa  4 

0  , 

(96) 

Pb  4 

0  , 

(97) 

for 

some  k  4  0  , 

(98) 

(a-bk)TA+(a-bk)  -  2k  *  0 

-ag¬ 


og) 
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> 

•r. 


Now  B  *  BT  ,  G  -  GT  ,  BG  ■  <BG)T  ,  and  (13)  -*•  GB  =  BG 
so  (5)  holds.  So 


BCB  ■  [AA+  +  Pu(uTPu)_1ijTP]  [A  +  u  uT  -  v  vT] 


I! 


-  AA+A  +  AA+U  -  v  v~  +  Pu(uTPu)  *(uTPu) 


k 


+  +  IT  IT 

=  A  +  (I  -  AA  +  A  A)u  —  u  ~  v  "2k  v 


,  IT  IT 

■A+U2k“  -V  2kV 


3  B 


And 


GBG  =  [A+A  +  Pu(uTPu)  1uTP ] [A+  -  A+vX  ^v^A+ 


_  .-1,-1  1  T,A+  .+  ,-l  T  +, 
-  Palp  X  —  u  (A  -  A  vX  vA) 


/A +  A+  ,-l  T.+,  1  ,-1.-1  T_ 

-(A  -  AvX  v  A  )u  —  X  ip  aP 


+  Paip_2X_1k2(aTA+abTA+b  -  (aTA+b  +  D^a^] 


2-\_Tt 


=  A+AA+  -  A+AA+vX-1vTA+ 


+  A+A(A+  -  A+vX_1vTA+)u  j  X"1ip"1aTP 


_  ,  T_  , -2  T_  ,-l  T,A+  a+  ,-l  T.+, 
-  Pu(u  Pu)  u  PuX  u  (A  -  A  vX  v  A  ) 


,  „  .  T_  ,-l,  Td  ,  1  -2.-1.  2r  TaA  ,Ta+.  .  Ta+, 
+  Pu(u  Pu)  (u  Pu)  —  ip  X  k  (_a  A  ab  A  b  -  (a  A  b 


+  A+  ,-l  Ta+ 
=  A  -  A  vX  v  A 


/A+  .+  I"1  TA+,  1  .-1,-1  T„ 

-(A  -  AvX  v  A  )u  —  ip  X  aP 


„  1  ,-1,-1  T,A+  a+  ,-l  Ta+. 

-  Pu  Ip  X  u(A  -  AvX  vA) 
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k 


(I  -  DD  )v  =  0  and 


vTD+v  ^  2k  , 


and  by  the  interlocking  property  of  eigenvalues  B  will  be  indefinite  if 

(109) 


v^D+v  >  2k 


Now  by  (108) 


T+  T+  T+  T  + 

vDv=vAv+2uAv+uAu+2k 


4aTA+  a  +  2k  >  2k  ,  V  k 


by  Lemma  1.  Hence  (109)  holds. 


Corollary  3: 
If 


Pa  4  0  , 

and 

Pb  4  0  , 


then  necessary  and  sufficient  conditions  for  B  to  be  positive  semidef- 
inite  are: 


(i)  Pa  =  Pbk  for  some  k  >  0  ,  and 

(ii)  (a  -  bk)TA+ (a  -  bk)  <  2k 


(110) 


Proof:  By  contraposition.  There  are  three  cases. 

(i)  Suppose  Pa  4  Pbk  for  all  k  .  Then  the  conditions  of  Theorem  7 
hold.  Define 


u  ■  a  +  bk  and 
v  =  a  -  bk  for  some  k  >  0  . 

X  T 

Then  Pu  4  0  ,  u  -jiT  u  is  a  positive  dyad,  D  =  A  +  u  —  uT 
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will  be  positive  semidef inite,  and  Rank(D)  =  Rank(A)  +  1  .  Now 
by  (82)  Rank(B)  =»  Rank(A)  +  2  ,  which  will  occur  if  and  only  if 

(I  -  D+D)v  *  0  . 


(  1 1  T 

But  v  -  —  v  is  a  negative  dyad.  This  with  the  above  gives 
Pa  ^  Pbk  for  all  k  if  and  only  if  B  is  indefinite. 

(ii)  Suppose  Pa  =  Pbk  for  some  k  <  0  .  Then  the  conditions  of  Theorem 
8  hold.  Define  u  ,  v  ,  and  k  as  in  Theorem  8.  Then  we  have 


2k 


vT  is  a  positive  dyad,  Pv  -  0  ,  vTA+v  -  2k  >  0  ,  and  by 


1  T 

Theorem  10,  D  3  A  -  v  v  remains  positive  semidef inite,  and 

Rank(D)  =*  Rank(A).  By  (89)  Rank(B)  -  Rank(A)  +  1  ,  which  occurs 
if  and  only  if  (I  -  DD+)u  ^  0  .  But  for  k  <  0  ,  u  ~  uT  is  a 
negative  dyad.  This  with  the  above  gives  for  Pa  t  0  ,  Pb  ^  0  , 
Pa  *»  Pbk  for  k  <  0  if  and  only  if  B  is  indefinite. 

(iii)  Suppose  Pa  =  Pbk  for  some  k  >  0  and  (110)  does  not  hold.  Then 
the  conditions  of  Theorem  8  hold.  Define  u  ,  v  and  k  as  in 
Theorem  8.  Then  Pu^0,Pv=0,D=A+u-^uT  will  be  pos¬ 
itive  semidefinite,  and  Rank(D)  =  Rank(A)  +  1  .  Now  (89)  gives 
Rank(B)  =  Rank(A)  +  1  ,  which  occurs  if  and  only  if 


(I  -  D+D)v  =  0  . 

IT 

B  *»  D  -  v  —  v  will  be  indefinite  if  and  only  if  (110)  does  not  hold. 
Hence  for  Pa  ^  0  ,  Pb  ^  0  , 
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Pa  =  Pbk  for  k  >  0  and  v^A+v  >  2k 

if  and  only  if  B  is  indefinite.  This  concludes  the  proof. 


It  will  also  be  useful  to  note  that  eigenvectors  (e^,e2)  anc*  as~ 

T  T 

sociated  eigenvalues  for  ab  +  ba  are 


h  "  flf  +  M  * 
s2  “  Tlf  '  fbl  * 


A1  =  a  b  +  ||a 


X2  =  aTb  -  || a 


and 


Proof : 


(abT  +  baT)e1  =  -|||-  +  -jjjy  (aTb  +  ||a||||b||)  =  e^ 


,  ,  T  ,  L  T.  a  b  ,  T.  it 

(ab  +ba)e2»-|I|-^|(ab  -  ||a 


-  e2A2  . 


T  T 

Note  that  ab  +  ba  can  be  expressed  as  the  sum  of  two  symmetric  dyads 


involving  e^  and  e2  ,  namely. 


abT  +  baT  ,  ^  JajjM  .* 


H- 


T  T 

and  that  the  first  of  these  is  the  positive  part  of  (ab  +  ba  )  . 


An  algorithm  for  estimating  the  positive  part  of  a  symmetric 
matrix  A  follows  from  the  preceding  results. 

We  assume  that  A  is  given  as 
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where 


i  i  “  1* • • • »Q  » 

aj’bj  *  j  =  ’  311(1 

t^  ,  f,  -  1,...,S  are  n  x  1  vectors, 

and 

ci>0  ,  i=l,...,Q  and 

r^  <  0  ,  i  »  1, . . . ,S  are  scalars. 

Denote 

min(k,Q)  _  min(k-Q.R)  _ 

*k  •  J1  Wi  +  £  <*JbJ  +  Vl>  *  I(k  >  ® 

k— Q— R 

+  l  t^t*  •  I(k  >  Q  +  R)  , 
ial 


where  !(•)  is  the  indicator  function. 


I(s) 


-I1  1 

10  i 


if  s  is  true 
if  s  is  false. 


and  denote  P.  *  I  - 
k 

With  each  iteration  the  algorithm  forms  an  estimate  A^  of  the 
positive  part  of  and  updates  its  generalized  inverse.  If  during 

the  course  of  processing  rank  two  perturbations ,  a  summand  is  encoun¬ 
tered  which  cannot  be  entirely  absorbed  without  yielding  A^  indefinite 
or  dropping  the  rank  of  A^  ,  the  summand  is  separated  into  two  symmetric 
parts  (one  positive  dyad  and  one  negative  dyad),  and  the  positive  dyad 
is  absorbed.  The  negative  dyad  is  then  added  to  the  set  of  negative 
dyads  for  possible  absorption  after  all  rank  two  summands  have  been 
processed.  The  algorithm  proceeds  in  the  following  manner: 
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Initialization 


Set  k*l  ,  A  *0  ,  M«Q  +  R+  S  ,  ,  Z* 

Iteration  k: 

If  k  >  Q  go  to  "C*. 

Set  \  ’  Vi +  Wk  • 

Update  A^  .  Set  k  *  k  +  1  and  go  to  *B*. 

If  k  >  M  go  to  *H*. 


If 

k  >  Q  +  R  go 

to  *F' 

» 

• 

Set 

i  =  k  -  Q  . 

If 

pk-i  ai  *  0 

go  to  ' 

■D* . 

If 

Pk-1  bi  *  0 

go  to 

•E*. 

T  + 

Compute  a  - 

-1  *1  * 

bX-ib« 

-  <aX-ibii + » 

If 

a  >  0  go  to 

•E*. 

Set 

A  »  A  + 
k  k-1 

Vi  + 

bl*I  • 

Update  A^  ,  set 

k  -  k 

+  1  and 

go  to  •  C* . 

If  =*  0  go  to  *E«. 


Compute 

3 

T 

3  Vk 

-lbJl 

/bJlPk-lbi  ’ 

If  8  < 

0 

go  to 

•E*. 

If  Pk-] 

LaJl 

*Pk-! 

b£-3 

go  to  *E» . 

Compute 

Y 

=  (a* 

-  V 

•B)X-i<at  -  yb)  - 26 

If  y  > 

0 

go  to 

•E*. 

Set  A. 
k 

"  \-l  + 

UT 
a  •.fa¬ 
il  i 

+  bA  • 

Update 

< 

,  set 

k  - 

k  +  1  and  go  to  »C» . 

Compute 
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v  -  a  ‘  W  -  b  •  Tbf  ■  *nd 


T 

Set  =  A^_i  +  uttu  . 

Update  A*  ,  set  k  =  k  +  1  . 


Set  M  »  M  +  1  ,  t^  “  v  ,  rM=_1T  *  and  g0  to  *C*‘ 

•F*  If  k  >  M  go  to  *H». 

Set  l  »  k  -  Q  -  R  . 

If  P^t^  =  0  go  to  *G* . 

Set  Ak  =  Ak_x  ,  A^  =  A^_x  f  Y  -  Y  U  U>  . 

Set  =  pk_1t£  »  k  -  k  +  1  and  go  to  *F*. 

a  -  x  +  -2^ 

•G*  Compute  r£  =  max^,  J  . 

If  »  set  Z  -  Z  U  {A}  ,  z%  -  A^t^  . 

Set  Ak  =  Ak_x  +  t^tj  . 

Update  Ak  ,  set  k  =  k  +  1  ,  and  go  to  *F*. 

•H*  Set  A  -  A^  .  End. 


In  the  manner  of  Emami  and  McCormick  (1978)  and  Sof er  (1984) ,  we 
can  observe  the  following: 

Note  that  for  k  >  Q  +  R  , 


Vi +  i  'jvJ  • 


Since  r^  <  0  for  all  j  >  Q  +  R  ,  we  see  that 

x^Ax  <  x^Ax  <  x^Aj^x  »  V  x  ,  k  >  Q  +  R  . 


(Ill) 


Thus  A  may  be  considered  an  overestimate  of  A  in  that  A  -  A  is 
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positive  semidefinite,  and  we  find  that  all  directions  of  positive 
curvature  for  A  are  also  directions  of  positive  curvature  for  A  and 
all  directions  of  zero  curvature  for  A  are  directions  of  nonpositive 
curvature  for  A  . 

At  the  conclusion  of  the  algorithm  the  set  Y  will  contain  the 
indices  of  those  negative  dyads  (some  of  which  were  separated  out  from 
rank  two  summands)  which  could  not  be  absorbed,  and  the  set  Z  will 
contain  the  indices  of  those  negative  dyads  which  caused  a  rank  decrease 
in  forming  A  . 

Now  for  each  y^  *  ^  e  ^  and  k  =  Q  +  R  +  £,  ,  it  fol¬ 

lows  from  (111)  that 

y^Ay^  <  y^Ak_1y^  +  (yjt^r^tjy^)  *  (tzPk-ltZ)2rZ  <  0  * 

Hence  each  y^  will  be  a  direction  of  negative  curvature  for  A  . 

Also  note  that  by  construction,  the  vectors  ,  Z  e  Z  ,  are 
directions  of  zero  curvature  for  A^  ,  (k  =  Q  +  R  +  Z)  ,  since  for  each  Z 


ZI\Z*  ’  cl 


Ak-i  [Vi  +  Ak-ite  =  0  •  (llz) 


So  from  (112)  we  see  that 


ziAzn  <  hVi  +  hh <rt  -  h)cIh 

•  - zt> < °  •  iez 


and  each  z^  will  be  a  direction  of  nonpositive  curvature  for  A  . 

If  r^  <  r^  ,  it  will  be  a  direction  of  negative  curvature  for  A  . 

From  (111)  we  also  see  that  any  direction  of  zero  curvature  for 
A^(k  >  Q  +  R)  is  also  a  direction  of  zero  curvature  for  A  and  so  all 
directions  x  e  (z^,  Z  e  Z)  U  (y^,  Z  e  Y)  are  directions  of  zero  curva¬ 


ture  for  A  . 
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The  preceding  algorithm  is  much  in  the  spirit  of  that  of  Emami 
and  McCormick  (1978)  with  the  following  exceptions: 

(a)  The  Emami-McCormick  algorithm  presupposes  that  all  rank  two  summands 
have  been  decomposed  in  some  manner  into  symmetric  dyads.  In  the 
algorithm  above,  rank  two  matrices  are  decomposed  and  the  positive 
part  absorbed  only  if  absorbing  the  whole  summand  at  that  stage  of 
the  algorithm  would  decrease  the  rank  of  A  or  leave  it  indefinite. 

(b)  Rank  two  summands,  when  decomposed,  are  divided  into  positive  and 
negative  parts  employing  their  spectral  decomposition.  Thus  at  any 
stage  of  the  algorithm,  if  only  part  of  a  rank  two  summand  can  be 
absorbed,  "all"  of  its  positive  part  is  absorbed.  It  is  hoped  that 
this  approach  will  yield  in  some  sense  a  more  accurate  estimate  of 
the  positive  part  of  A  .  That  it  will  in  the  trivial  case  can  be 
seen  by  the  following  example. 


Suppose  A  =  0  ,  a  =*  ^  and  b  =  l]  ’ 


Then  A  +  ab1"  +  baT 


is  indefinite,  with  one  positive  and  one  negative  eigenvalue. 

T  T 

Now  also  suppose  that  (ab  +  ba  )  is  decomposed  into  two  sym¬ 


metric  dyads 


IT,  (  ll  T 
u|  u  +  T  v  j  where 


u  =•  a  +  b 


and  v  =  a  -  b  = 


(3 


(this  is  commonly  done).  By  the  algorithm  above. 
At  Iteration  1, 


p0  “  1  >  PQa  -  a  j  0  ,  PQb  -  b  +  0  , 
PQa  i  PQbk  for  all  k  , 
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II  a  I  =  5  ,  |b  I  »  1  • 
So 


v  ((:!].(:]] -It:)  *(:])’ 

■  (:;|  i.t  ■ 

A1  ■  (ils)  *0309  (-6’1-8)  * 

M  -  M  +  1  -  1  ,  t1  =  _*8)  .  rx 


At  Iteration  2, 


and  the  algorithm  terminates  with  A  ■  A^  *  the  positive  part 
of  A  . 


By  the  Emami-McCormick  algorithm. 
At  Iteration  1, 

P  ■  I  ,  Pu  *  u  ^  0  ,  so 

A1  ’  5  2  (3’5)  ’  311(1 

A+  -  3  .0017  (3,5)  . 

At  Iteration  2, 


f  .14706 

-.441181 

(-.44118 

|_-.  44118 

.  26471_j 

*  1  [-.52941 

The  negative  dyad  cannot  be  absorbed  and  the  algorithm  terminates 
with  the  estimate  A  ■  A^  f  the  positive  part  of  A  . 
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